Method and system for rule based display of sets of images

ABSTRACT

The invention provides, in some aspects, a system for implementing a rule derived basis to display image sets. In various embodiments of the invention, the selection of the images to be displayed, the layout of the images, as well as the rendering parameters and styles can be determined using a rule derived basis. In an embodiment of the present invention, the user is presented with images displayed based on their preferences without having to first manually adjust parameters.

PRIORITY CLAIM

This application is a continuation of (1) U.S. application Ser. No.16/446,546 filed Jun. 19, 2019 entitled “Method And System forRule-Based Display of Sets of Images”, inventors: Malte Westerhoff and DStalling”, which is a continuation of (2) U.S. application Ser. No.15/870,681 filed Jan. 12, 2018 entitled “Method And System forRule-Based Display of Sets of Images”, inventors: Malte Westerhoff and DStalling and issued Aug. 6, 2019 as U.S. Pat. No. 10,373,368 which is acontinuation of (3) U.S. application Ser. No. 15/380,848 filed Dec. 15,2016 entitled “Method And System for Rule-Based Display of Sets ofImages”, inventors: Malte Westerhoff and D Stalling and issued Feb. 20,2018 as U.S. Pat. No. 9,898,855 which is a continuation of (4) U.S.application Ser. No. 14/611,163 filed Jan. 30, 2015 entitled “Method AndSystem for Rule-Based Display of Sets of Images”, inventors: MalteWesterhoff and D Stalling and issued Dec. 20, 2016 as U.S. Pat. No.9,524,577 which is a continuation of (5) U.S. application Ser. No.13/831,967, entitled “Method And System for Rule-Based Display of Setsof Images”, inventors M. Westerhoff et al, which was filed Mar. 15, 2013and issued Mar. 10, 2015 as U.S. Pat. No. 8,976,190, where (1) through(5) are herein expressly incorporated by reference in their entireties.

BACKGROUND OF THE INVENTION

In order to diagnose a traditional X-Ray examination, the images printedon films would be ‘hung’ in front of a light box. For multi-imageexaminations, as well as for comparison with priors, the ‘hanging’ wouldoften follow a specific protocol. For example, a particular organizationor doctor may choose for a two-view chest X-Ray with a two-view priorexam, that the films be hung from left to right as follows: Frontal viewof current examination, lateral view of current examination, frontalview of prior examination, lateral view of prior examination. Incontrast, the doctor may hang mammography exams with the correspondingviews of current and prior next to each other, if that was moreappropriate for the diagnostic workflow in that case. Thus, theorganization or doctor developed a traditional ‘Hanging Protocol’.Currently, the film and the light box are often being replaced bycomputer systems, called PACS (Picture Archiving and CommunicationSystem). PACS systems can mimic the Hanging Protocols.

Traditional X-Ray examinations typically produce one or a small numberof single two dimensional (2D) images. In contrast, the more advancedimaging modalities such as Computer Tomography (CT), Magnetic ResonanceImaging (MRI) or Positron Emission Tomography (PET) can produce dozensof series, each consisting of a hundred or more images. It is possibleand not uncommon to review images from these advanced modalities in thesame manner as traditional X-Ray images, i.e., by hanging the individualimages side-by-side, either on a light-box or using a PACS system.

SUMMARY OF THE INVENTION

The invention pertains to digital data processing and, moreparticularly, by way of example, to the visualization of image data.Three dimensional (3D) and four dimensional (4D) image data is routinelyacquired with CT, MRI, PET, confocal microscopes, 3D ultrasound devices,and other imaging devices. The medical imaging market is just oneexample of a market that uses these devices. The visualization of imagedata market is growing rapidly, with new CT scanners collecting largeramounts of data more quickly than previous generation CT scanners. Theinvention has application to areas including medical imaging,atmospheric studies, astrophysics and geophysics.

With the rapid increase in the amounts and types of information that canbe acquired using imaging technology, we have identified a substantialproblem with integrating different types of image-based information intoa form that can be used by a physician or diagnostician. Namely,although there may be many different types of image data, the forms,formats, integration, and display of relevant information is extremelydifficult for a person to carry out without sophisticated computerprocessing. Embodiments of this invention therefore provide acomputer-based analytic framework whereby image-based information from avariety of different sources can be integrated to provide increasedability to diagnose and evaluate a patient's condition. We haveidentified another substantial problem in the art, namely the increasedlikelihood of confusion of image-based information from differentpatients. In such situations, a physician or diagnostician may bepresented with image-based information from different patients. Suchinadvertent conflation can produce mis-diagnosis or mistakennon-diagnosis. In each case, the outcome for the patient can be serious,and can result in increased morbidity and mortality.

In general aspects of this invention, a First Study is first selectedfor review by a physician or diagnostician. Selection of a Study willgenerally be based on some particular characteristic. Suchcharacteristic can be anatomical, disease-based, or both. Once a FirstStudy is selected, an Additional Candidate Study can be selected basedon the anatomical location of the First Study. Therefore, if the FirstStudy is a Chest X-Ray, an Additional Candidate Study can be a Chest CTscan, MRI, positron-emission tomography (PET) scan, or other image ofthe chest. Alternatively, if a First Study is an X-Ray image of thegastrointestinal tract, an Additional Candidate Study could be a seriesof X-Ray images taken after ingestion of a contrast agent (such asbarium). It can be appreciated that such anatomically selectedAdditional Candidate Studies can be applied to any organ, organ system,or tissue.

Alternatively, Additional Candidate Studies can be selected based on thetype of disorder of disease being evaluated. For example, in a case inwhich a patient has had a diagnosis of cancer of one organ (e.g., lung),it can be desirable for Additional Candidate Studies to be targeted toidentification of metastases in another organ. Thus, if a First Study isa Chest X-Ray, an Additional Candidate Study can be of the lymphaticsystem, head and neck, or various abdominal quadrants. Such AdditionalCandidate Studies may be X-ray, CT scans, MRI scans, PET scans, vascularvisualizations (e.g., with injected contrast media) or histologicalimages taken during a biopsy. Because the degree of detail (i.e.,“granularity”) obtained using different imaging techniques may varywidely it can be desirable to have a Rule Based process whereby thegranularity of an Additional Candidate Study is increased over that ofthe First Study.

For example, a Chest X-Ray is a two-dimensional image in which theentirety of the chest and lungs is represented as a flat image. AnAdditional Candidate Study could be a CT scan, where “2-dimensional”images are acquired at a series of different “depths” (e.g., “slices”)through the organ. If the 2-dimensional images are of sufficient qualityto produce a 3-dimensional image of the organ with desirable degree ofgranularity, then the Additional Candidate Study can be depicted anddisplayed along with the image of the First Study.

General Rule 1 for selecting an Additional Candidate Study therefore canbe:

IF (Primary.Dicom.BodyPartExamined) is “ANATOMICAL REGION 1”, and(Primary.Dicom.Modality=IMAGE TYPE 1”).

THEN SELECT other studies for loading, WHERE (Other.Dicom.BodyPartExamined=ANATOMICAL REGION 1”) and (Other.Dicom.Modality=“IMAGE TYPE2”).

If desired, in General Rule 1, Additional Candidate Studies can target“Other.Dicom.Modality=“IMAGE TYPE 2”).

It can be appreciated that any number of Additional Candidate Studiescan be integrated using the computer-based processes of this invention.

Alternatively, General Rule 2 for selecting an Additional CandidateStudy therefore can be:

IF (Primary.Dicom.Disease) is “DISEASE 1”, and(Primary.Dicom.Modality=IMAGE TYPE 1”)

THEN SELECT other studies for loading, WHERE(Other.Dicom.Disease)=“DISEASE 1”) and (Primary.Dicom.Modality=“IMAGETYPE 2”).

It can be readily appreciated that application of General Rule 2 canintegrate other Anatomical Regions and a number of different ImageTypes. It can also be appreciated that using “DICOM” in the rules, thelikelihood of conflation of images from different patients can besubstantially or completely eliminated.

Additionally, to consider information derived from different patientssimultaneously, the selection for “DICOM” can be in a First Study,“DICOM 1” and THEN SELECT an image from “DICOM 2.” Integrating thisadditional feature into a Rule Based computerized system can permitdetection and analysis of disease “clusters” (e.g., cancer clusters;toxin-induced clusters, infection clusters, and the like).

In an embodiment of the present invention, a method or system uses arule derived basis to display image sets. In various embodiments of thepresent invention, the selection of the images to be displayed, thelayout of the images, i.e., the hanging, as well as the renderingparameters and styles can be determined using a rule derived basis. Inan embodiment of the present invention, the user is presented withimages displayed based on their preferences without having to firstmanually adjust parameters. Accordingly, there is a time saving in notdisplaying images initially in a non-rule derived basis.

These and other aspects of the invention are evident in the drawings andin the description that follows.

BRIEF DESCRIPTION OF THE DRAWINGS

This invention is described with respect to specific embodimentsthereof. Additional features can be appreciated from the Figures inwhich:

FIG. 1 depicts a flow chart showing the steps of applying various rulesto the selected Study, according to an embodiment of the invention;

FIG. 2 depicts the resulting display for an example study, according toan embodiment of the invention; and

FIG. 3 shows an example of a user interface to specify rules including adialog box to configure Study Selection rules, according to anembodiment of the invention.

DETAILED DESCRIPTION OF THE INVENTION Definitions

The transitional term “comprising” is synonymous with “including,”“containing,” or “characterized by,” is inclusive or open-ended and doesnot exclude additional, unrecited elements or method steps.

The transitional phrase “consisting of” excludes any element, step, oringredient not specified in the claim, but does not exclude additionalcomponents or steps that are unrelated to the invention such asimpurities ordinarily associated with a composition.

The transitional phrase “consisting essentially of” limits the scope ofa claim to the specified materials or steps and those that do notmaterially affect the basic and novel characteristic(s) of the claimedinvention.

The term “Study” will be used to refer to the set of images produced byan examination. A Study consists of one or more images. The images canbe grouped into one or more image series. Each image, each series, andthe whole Study can have different parameters attached. For medicalimages these can be defined by the Digital Imaging and Communication inMedicine (DICOM) standard.

The term “Hanging Protocol” will be used to refer to specificconventions how X-Ray films are arranged (hung) at a light box.

The term “Display Protocol” will be used to refer to the way images aredisplayed in a computer system, specifically the selection of the imagesto be displayed, the layout of the images, as well as the renderingparameters and styles.

The term “View” will be used to refer to data corresponding to a digitalimage view of a Set of Images rendered with a given set of renderingparameters and rendering modes.

The term “Viewport” will be used to refer to the logical part of thescreen on the client computer in which a particular View is displayed,for example the user interface on the client computer can contain fourrectangular Viewports 1160 of which three show a frontal, left, andbottom view respectively of a particular data, while the fourth viewermight show a 2D cross section through the same or a different data set.

The term “Sets of Images” or “Image Set” will be used to refer to one ormore images, selected based on the rules.

The term “Study Selection Rules” will be used to refer to the rules usedto select the studies to be displayed.

The term “Protocol Selection Rules” will be used to refer to the rulesused to select the layout of the images to be displayed.

The term “Image Set Rules” will be used to refer to the rules used toform Image Sets 1165 from the images of one or more Study by applyingselection, sorting, and breaking rules.

The term “Style Rules” will be used to refer to the rules to determinewhich rendering type, rendering style, and rendering parameters are usedfor a particular Image Set 1165 in a particular viewer.

The term “Volume Rendering” will be used to refer to Volume Renderingtechniques including shaded Volume Rendering techniques, maximumintensity projection (MIP), oblique slicing or multi-planar reformats(MPR), axial/sagittal and coronal slice display, and thick slices (alsocalled slabs). In medical imaging, for example, Volume Rendering is usedto display 3D images from 3D image data sets, where a typical 3D imagedata set is a large number of 2D slice images acquired by a CT or MRIscanner and stored in a data structure.

Overview

Often, the traditional ‘Hanging Protocol’ is either not intuitive,cannot display the information in a manner in which it can be reviewedor is not the most efficient way to display images. Alternative ways ofrendering the acquired images can be more efficient or more appropriatefor displaying the information. Examples include Volume Renderingtechniques or maximum intensity projections of stacks of cross-sectionalimages, rendering of oblique slices, rendering of thick slices or slabs,or rendering of fused images (e.g. in PET/CT). Specialized diagnosticworkstations that are often specific to a clinical application area areused to provide appropriate rendering of the acquired images. Asorganizations and doctors require better and faster visualizationmethods that allow users to interact with the image data in real-time,the requirements and demands for displaying the data will increase.

FIG. 2 depicts an example study where the rules have created two Sets ofImages. One Set of Images consists of a series of CT images forming a 3Dvolume, which is depicted in a volume rendered style in the Viewport1160 in the upper left and in three orthogonal cross sections in thethree other viewports in the left half of the screen. The second Set ofImages consist of one chest X-Ray, assigned to a single Viewport 1160covering the right half of the screen and rendering the X-Ray in 2Dstyle. Appropriate data windows have been chosen by the rules tohighlight the vasculature in the 3D rendering, as this is a study withcontrast, as the rules can determine by the StudyDescription containingthe word ‘contrast’.

FIG. 1 is a flow chart showing how the rules are used to create the twoSets of Images shown in FIG. 2. As shown in FIG. 1, a primary Study 1105which can be manually selected by a user. In step (i) 1120, based onStudy Selection Rules 1115 which interrogate parameters in the primaryStudy 1105 such as DICOM Parameters and Abstract Tags of both theprimary Study 1105 and the candidate studies 1110, the Study SelectionRules 1115 can identify additional candidate studies 1110. The secondset of studies 1125 which includes the candidate studies 1110 and theprimary Study 1105 are available to be loaded into Viewports 1160. Instep (ii) 1140, the Protocol Selection Rules 1135 select a DisplayProtocol 1145 from the Available Display Protocols 1130 based on DICOMParameters and Abstract Tags present in the second studies 1125. In step(iii) 1155, Image Set Rules 1150 are used to define a plurality of ImageSets 1165 from the second studies 1125. The one or more Viewports 1160are defined in the Display Protocol 1145. In step (iv) 1175, ViewportAssignment Rules 1170 assign one or more Image Sets 1165 to one or moreViewports 1160. In step (v) 1185, Style Rules 1180 define a renderingstyle and rendering parameters. In an embodiment of the invention steps(i) through (v) are performed by a server processor running a renderserver program with an interface shown in FIG. 3 in which the rules(Study Selection Rules 1115, Protocol Selection Rules 1135, Image SetRules 1150, Viewport Assignment Rules 1170, and the one or more StyleRules 1180) are used to automatically select and display the Image Sets1165 in the Viewports 1160.

A render server program is described in U.S. application Ser. No.13/831,967, entitled “Multi-User Mult-GPU Render Server Apparatus andMethods”, inventors M. Westerhoff et al., which was filed Mar. 15, 2013,is herein expressly incorporated by reference in its entirety. A rulebased render server program is described in U.S. application Ser. No.13/831,982, entitled “Method and System for Transferring Data to ImproveResponsiveness when Sending Large Data Sets”, inventors D Stalling etal., which was filed Mar. 15, 2013 and issued Nov. 29, 2016 as U.S. Pat.No. 9,509,802, is herein incorporated by reference in its entirety.

Study Selection Rules 1115

In an embodiment of the present invention, based on the Study that theuser selects for display (primary Study 1105), the system can firstapply user defined rules to determine additional studies to be displayedtogether with the primary Study 1105. Such additional studies can beprior examinations that are relevant for the diagnosis of the currentStudy, or additional current studies. For example, a PET examinationwill often be looked at together with a CT examination acquired at thesame time. The set of rules are constructed as follows:

Each rule consists of a matching criterion for the primary Study 1105(primary condition), as well as matching criteria for additional studies(secondary condition). The matching criterion is an expressionconsisting of operators that allow evaluating the parameters of theStudy and comparing them to defined values. The parameters of the Studyare any parameters defined by the DICOM standard, such as StudyDescription, Study Date, Modality, Patient Age, as well as any otherparameters that can be derived from the DICOM parameters or from theStudy itself, such as number of images, or number of image series. Theoperators are numeric or string based operators, such as equals, greaterthan, less than, contains, etc. Expressions can be combined usingBoolean operators such as AND, OR, NOT. Operators can also contain morecomplex expressions, including user defined functions defined in anappropriate programming language, such as JavaScript or VisualBasic.

Once a primary Study 1105 has been selected for display, the primarycondition of each rule is evaluated. Those rules that match, i.e.,evaluate to “true” for the given primary Study 1105, will then beapplied to all other studies that are available for the same patient.Those other studies for which the secondary condition matches will beadded to the list of studies to be displayed.

The following rule illustrates the concept. This rule will automaticallyload prior Chest X-Rays or prior Chest CT if the primary Study 1105 is aChest X-RAY.

Study Selection Rule 1:

IF (Primary.Dicom.BodyPartExamined=“CHEST” andPrimary.Dicom.Modality=“CR”) THEN SELECT other studies for loading WHERE(Other.Dicom. BodyPartExamined=“CHEST” and (Other.Dicom.Modality=“CR” orOther.Dicom.Modality=“CT”))

The rule is expressed in pseudo-code with the primary conditionspecified in the IF-clause and the secondary condition expressed in theSELECT-clause.

Study Selection Rules: Normalization of DICOM Parameters

In an embodiment of the present invention, the rules can normalize DICOMparameters. As described above, a Study Selection Rule can containarbitrary DICOM parameters. The DICOM standard specifies if a particularparameter is defined on a patient, Study, series, or image level. Forexample, a Study-level parameter should have the same value in allimages of a Study, while a series-level parameter should have the samevalue in all images of a series. There are two problems related toassuming that this statement is always the case. Firstly, although aStudy-level tag should have the same value for all images of a Studythis is not always true. Secondly, some parameters are defined on aseries- or image-level (e.g. modality is a series-level parameter) andtherefore can be unavailable. In both cases it can be unclear what valueis to be used when evaluating the rule. The invention described hereprovides different solutions to this problem.

In an embodiment of the present invention, a first approach is to choosea reference image and to read the value of a particular DICOM parameterfrom the reference image. The reference image can be: (i) the image thatwas inserted into the system first, (ii) the image with the oldest imagecontent date, (iii) the image that was inserted into the system last, or(iv) the image with the earliest image content date. The choice of whichimage is to be chosen as the reference image can be configured for eachparameter separately.

In an embodiment of the present invention, a second approach is to onlyallow original images to be chosen as the reference image. Non-viewableDICOM objects like structured reports, key objects, or presentationstates are disregarded, as well as derived images such as secondarycapture images or reformatted images.

In an embodiment of the present invention, a third approach is toprovide a list of all distinct values that a particular DICOM parameterhas in the images of a Study. In a Study Selection Rule one can thencheck if that list contains a particular value. The example above canthen read as follows:

Study Selection Rule 2:

IF (Primary.Dicom.BodyPartExamined=“CHEST” andPrimary.DicomList.Modality contains “CR”) THEN SELECT other studies forloading WHERE (Other.Dicom.BodyPartExamined=“CHEST” and(Other.DicomList.Modality contains “CR” or Other.DicomList.Modalitycontains “CT”))

Study Selection Rules: Abstract Tags

In an embodiment of the present invention, the Study Selection Rules1115 contain other derived parameters such as Abstract Tags thatcharacterize a Study in addition to or instead of DICOM parameters.Abstract tags that are useful within Study Selection Rules 1115 includethe following:

-   -   (i) RelativeStudyAge indicates relative age of Study in days        compared to primary Study 1105.    -   (ii) PriorIndex indicates an index that enumerates all other        studies from youngest to oldest.    -   (iii) NumImages indicates number of images in Study.    -   (iv) NumSeries indicated number of image series in Study.    -   (v) Num3DVolumes indicates number of 3D volumes in Study.    -   (vi) Num4DSequences indicates number of 4D sequences in Study        (e.g. Cardiac CT).    -   (vii) HasReport indicates a flag that indicates if a report is        available for a Study.    -   (viii) HasThinSliceVolumes indicates whether the study has at        least one set of images that form a true 3D volume, i.e. a        sufficiently large number of equidistant slices (the exact        number can be user configurable, e.g. 30 would be a common        choice) and a sufficiently small spacing between two consecutive        slices to guarantee an isotropic (or close to isotropic) (again,        this parameter can be user defined, values between 1 mm and 3 mm        are common thresholds for CT and MR examinations).

For example, a rule that applies to a Mammogram Study and that selectsat maximum three prior Mammogram studies no older than five years canread as follows:

Study Selection Rule 3:

IF (Primary.Dicom.Modality=“MG” THEN SELECT other studies for loadingWHERE (Other.Dicom.Modality=“MG” and Other.Abstract.Priorindex<=3 andOther.Abstract.RelativeStudyAge<5*365)

Protocol Selection Rules 1135

In an embodiment of the present invention, once the studies to bedisplayed are determined as described above, a suitable display protocolcan be selected. This is done using matching rules. Each matching ruleconsists of conditions that are applied to the primary and other studiesto be loaded. Like in Study Selection Rules 1115, protocol selectionrules may contain DICOM parameters (either taken from a reference imageor provided as a list of distinct values gathered from all images of astudy), as well as abstract tags and user-defined functions. Eachmatching rule has a score and an associated display protocol.

In an embodiment of the present invention, all matching rules areevaluated and the display protocol of the matching rule that evaluatesto true can be selected. If multiple matching rules evaluate to true,the one with the highest score can be selected.

The following example rule illustrates a matching rule that can applyfor PET/CT studies of the abdomen to select a protocol named“StandardPetCTProtocoll” with a score of 10.

Protocol Selection Rule 1:

IF (Primary.Dicom.BodyPartExamined=“ABDOMEN” andPrimary.Dicom.Modality=“CT” and Exists(Other1) andOther1.Dicom.Modality=“PET”) THEN SELECT “StandardPetCTProtocoll” withscore=10

In an embodiment of the present invention, the rule is expressed inpseudo-code with the matching condition specified in the IF-clause andthe chosen protocol specified by the SELECT.

Image Set Rules 1150

In an embodiment of the present invention, once a display protocol isselected, further rules defined within the protocol are evaluated. Thenext step comprises creation of so-called image sets. An image setconsists of images that are logically grouped together. Usually, animage set is represented by a single preview icon in the application. Itis an image set that is loaded into a viewer or tiled viewer. Note thatDICOM series also represent a logical grouping of images. However, oftenDICOM series are not well suited for hanging of images and viewing. Forexample, in Mammography a single DICOM series may contain images of bothleft and right breast, in MRI it may contain both T1 and T2 images, orin CT it may contain both a localizer image (topogram) and a 3D imagestack. In all these cases the DICOM series can be split into differentlogical image sets. On the other hand, multiple DICOM series mayrepresent the phases of a single 4D cardiac data set. In this case allthose series can be joined into a single logical image set.

Thus the creation of image sets based on rules is a key component of therule-based display system, specifically for the more advanced renderingtechniques. For example, the rules-based display system is used tocreate image sets that are very similar to the rules described above inStudy Selection Rules 1115 and Protocol Selection Rules 1135 sections. Arule is a Boolean expression that can contain DICOM parameters, abstracttags, or used-defined functions that are based on the DICOM parameters,abstract tags, or used-defined functions. Image set rules however, areapplied to all images of a study that was selected for loading (and notto the study itself). Image-level parameters thus represent no problemand do not need to be normalized or otherwise treated specially. Allimages that match an image-set rule are grouped into a respective imageset.

In an embodiment of the present invention, the following rule (expressedin pseudo-code) collects all images of a current CT study:

Image Set Rule 1: IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1

In an embodiment of the present invention, the resulting image sets canbe assigned IDs or names that allow for referencing the image sets laterin layout and display set rules. In the above example an image set withID 1 was defined. If no image matches an image set rule, no suchcorresponding image set will be created.

Image Set Rules: Sorting

In an embodiment of the present invention, the order of images within animage set is an important aspect. It determines how images are shownwhen the user browses through the image set or how images aredistributed into the tiles of a tiled viewer. In one embodiment of thepresent invention, in order to specify image sorting, the image setrules can contain an ordered list of sorting criteria. All images thatare matched by a rule are sorted according to those criteria.

For example, the following rule collects all images of a current CTstudy and sorts them according to DICOM series number at first and DICOMinstance/image number at second.

Image Set Rule 2: IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1

SORTED BY Dicom.SeriesNumber ORDER:=ascending

SORTED BY Dicom.InstanceNumber ORDER:=ascending

Image Set Rules: Splitting

In an embodiment of the present invention, sorting criteria can beextended by a split flag. With the split flag it is possible to createmultiple image sets from a single image set rule. When the value of asorting criterion with split flag set to true changes, sub-sequentimages are automatically inserted into a new image set. The resultingimage sets are automatically enumerated by a sub-level ID.

For example, the following rule essentially creates image sets thatcorrespond to DICOM series, because all images with different seriesnumber will be split into different sets:

Image Set Rule 3: IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1.x

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false

In applications where a CT has been measured, it can happen that a studycontains both a soft-kernel series and a hard kernel series and bothseries have the same series number. In order to separate the images intodifferent image sets the above rule can be extended by the following:

Image Set Rule 4: IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1.x

SORTED BY Condition.CTSoftTisseKernel SPLIT:=true

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false

Here, Condition.CTSoftTissueKernel denotes a user-defined Booleancondition that tests whether an image has a CT soft-tissue kernel. Theactual implementation of this condition can for example evaluate themanufacturer (which is encoded in a DICOM parameter). Depending on itsvalue the rule can evaluate further parameters to find out if an imagewas reconstructed using a soft-tissue kernel or not. Since this Booleancondition was used as a sorting criterion with the split flag set totrue, all non-soft-kernel images can be put into an image set with ID1.1 and all soft-kernel images can be put into an image set with ID 1.2(unless the image set is further split and IDs like 1.3 or 1.4 arecreated).

Image Set Rules: More Abstract Tags

In an embodiment of the present invention, additional abstract tags areused in image set rules. One example is a tag that identifies whether animage has already been put into an image set. In principle, a singleimage can be put into multiple image sets, but sometimes this should beavoided. This can be achieved by evaluating image set rules in apre-defined order and introducing an abstract tag AlreadyReferenced.

For example, in CT study that has a localizer image and a 3D image stackboth stored in one DICOM series, one may want to create an image set,one for the localizer and one for the 3D image stack. Accordingly, theimage set rules are defined as follows:

Image Set Rule 5 (Localizer):

IF (Dicom.Modality=“CT” and Condition.IsLocalizer=true)THEN CREATE image set with ID 1

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false

Image Set Rule 6 (Images):

IF (Dicom.Modality=“CT” and Abstract.AlreadyReferenced=false)THEN CREATE image set with ID 2

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false

Here Condition.IsLocalizer is a user-defined condition that returns trueif an image is a localizer image, and false otherwise. In an embodimentof the present invention, Rule 1 is applied first. Therefore thelocalizer image is put into a separate image set with ID 1. Next rule 2is applied. This rule can match for all CT images including thelocalizer image. However, because AlreadyReferenced=false is specified,the localizer image is skipped and not placed into image set 2.

In an embodiment of the present invention, the creation of the imagesets based on rules is a key component of the efficient rules baseddisplay, specifically for the more advanced rendering techniques. Forexample rules can be used to identify sets of 2D images that togetherform a 3D volume.

Viewer Assignment Rules

In another embodiment of the present invention, a display protocoldefines multiple viewers, each with one or more tiles, i.e., viewports.To each viewer one or more image sets can be assigned based on ViewerAssignment Rules that are similar to the protocol section rulesdescribed herein. Viewer Assignment Rules are defined in the displayprotocol. The rules determine which image set shall be initially shownin a viewer. In case multiple image sets are assigned to a viewer, theone with the highest score is chosen. Afterwards users may cycle quicklythrough the remaining image sets using dedicated tools (Previous/NextImage Set), or pick another image set from a special image set menu.

Like the other rule types Viewer Assignment Rules contain Booleanexpressions of DICOM parameters, abstract tags, or user-definedconditions based on DICOM parameters, or abstract tags. In many cases itis sufficient to specify the image sets to be assigned to a viewer bytheir image set ID instead of evaluating the underlying DICOM parametersand abstract tags again. Therefore, the image set ID is simply set as aseparate abstract tag. In the following example the two rules load imagesets with the IDs 1 and 2 into a viewer, but assign ID 1 a higher scoreso that this image set is initially visible (provided such an image setexists):

Viewer Assignment Rule 1: IF (EXISTS ImageSet[1])

THEN Viewport[0].AddImageSet(ID=1, score=10)

Viewer Assignment Rule 2: IF (EXISTS ImageSet[2]) THEN

Viewport[0].AddImageSet(ID=2, score=5)

In an embodiment of the present invention, viewer assignment rules areapplied to image sets. Thus there is a possible conflict regardingambiguous image-level and series-level tags. This conflict is resolvedin the same way as described herein in the Normalization of DICOMParameters section. This means that values of DICOM parameters, but alsoabstract tags, are automatically taken from some reference image.Alternatively, for all DICOM parameters a list of distinct valuesoccurring in all images of the image set can be used in an assignmentrule.

Style Rules

In one embodiment of the present invention, there is a final set ofrules that specify the rendering style and other rendering parameters tobe used when showing a particular image set. For example, for a CTAngiogram study, often a volume rendering style display (VRT) isdesired, whereas for a study looking for lung nodules a maximumintensity projection (MIP) of 20 mm slabs may be desired. Style rules,that can be user specific, allow driving that automatically. The rulescan use the same parameters as discussed above, as well as the existenceor absence of certain image sets.

In one embodiment of the present invention, the system uses a global,ordered list of style rules that is evaluated independently for eachviewer and each image set loaded into a viewer. An abstract tagDisplaySetID is provided that allows formulating style rules for aspecific viewer or group of viewers.

Parameters driven by Style Rules include the following:

-   -   i) Rendering style (can be 2D, oblique, curved, MIP slab, 3D        MIP, VRT, shaded VRT, etc.);    -   ii) Image alignment (left, right, top, bottom, centered);    -   iii) Inverse display (black on white versus white on black);    -   iv) Colormap or transfer function;    -   v) Window/level (data window);    -   vi) Slice thickness;    -   vii) Zoom factor;    -   viii) Camera position and orientation; and    -   ix) Labels/OverlayDisplay of labels, annotations and other        overlay elements.

The following is an example of a style rule that activates inverse 3DMIP rendering in all viewers with a DisplaySetID between 101 and 104,provided a PET data set is loaded into those viewers (modality PT, i.e.,positron emission tomography). Also, an automatic window/level settingis used that is computed from the histogram of the image set (the 2%lowest values are all mapped to white, and the 2% highest values are allmapped to black):

Style Rule 1: IF (Abstract.DisplaySetID>100 and

Abstract.DisplaySetID<105 and

Dicom.Modality=“PT”)

THEN SET

RenderingStyle:=“3D MIP”

Inverse:=true

DataWindow:=“2% 98%”

The following is another example of a different style rule that alwayscauses the image set with image set ID 200 to be displayed in MPR modeusing 20 mm thick slices, with a window/level as specified in the DICOMparameters, and with a zoom factor so that the whole viewer window isfilled out. The rule is:

Style Rule 2: IF (Abstract.ImageSetID=200) THEN SET

RenderingStyle:=“MPR”

SliceThickness:=“20”

DataWindow:=“DICOM1”

ZoomFactor:=“FitToWindow”

Summary of Rule Types

Table I summarizes all types of rules that are applied in the rule-basedisplay system:

TABLE I Normalized Rule Type Applies to Parameters Defined where StudySelection Rule Studies yes globally Protocol Selection Studies yesglobally Rule Image Set Rule Images not required protocol ViewerAssignment Image Sets yes globally, Rule protocol Style Rule Image Setsyes globally, protocol

Described above are methods and systems for implementing a rule derivedbasis to display image sets. The foregoing description of embodiments ofthe methods, systems, and components of the present invention has beenprovided for the purposes of illustration and description. It is notintended to be exhaustive or to limit the invention to the precise formsdisclosed. Many modifications and variations will be apparent to one ofordinary skill in the relevant arts. For example, steps performed in theembodiments of the invention disclosed can be performed in alternateorders, certain steps can be omitted, and additional steps can be added.The embodiments were chosen and described in order to best explain theprinciples of the invention and its practical application, therebyenabling others skilled in the art to understand the invention forvarious embodiments and with various modifications that are suited tothe particular used contemplated. Other embodiments are possible and arecovered by the invention. Such embodiments will be apparent to personsskilled in the relevant art(s) based on the teachings contained herein.The breadth and scope of the present invention should not be limited byany of the above-described exemplary embodiments, but should be definedonly in accordance with the following claims and their equivalents.

Example Shown in FIG. 2

An example of how these aspects can be combined is shown in FIG. 2. Inthe example the user has selected a CT examination of the abdomen. Thefollowing rules have been used to determine that a recent X-Ray of thechest is relevant and shall be displayed as well:

IF (Primary.Dicom.BodyPartExamined=“ABDOMEN” andPrimary.Dicom.Modality=“CT”) THEN SELECT other studies for loading WHERE(Other.Dicom. BodyPartExamined=“ABDOMEN” OR Other.Dicom.BodyPartExamined=“CHEST”) and (Other.Dicom.Modality=“CR” orOther.Dicom.Modality=“CT”) AND Other.RelativeStudyAge<“90 days”

From this rule, a hanging protocol can be selected. In the example theprotocol selection rules determine that the CT study is a thin slice CTstudy (i.e. that it has image series that form a 3D volume withsufficient resolution in all directions to display volume rendering ornon-axial slices in a meaningful way). Furthermore the example ruledetermines that this is a study with enhanced vasculature, by lookingfor the key words “contrast” or “angio” in the study description. Thedisplay protocol selection rule that applies here and select theprotocol CTThinSliceVesselWithPrior can read

IF (Primary.Dicom.BodyPartExamined=“ABDOMEN” andPrimary.Dicom.Modality=“CT” and Primary.Abstract.HasThinSliceVolumes and(Primary.Dicom.StudyDescription containsAnyOf “contrast, angio” andexists Other1 THEN SELECT “CTThinSliceVesselWithPrior” with score=10

From this image sets are generated using Image Set Rules:

IF (Dicom.Modality=“CT” and Abstract.Priorindex=0 andCondition.IsPartOfThinSliceVolume and Condition.CTSoftTisseKernel)

THEN CREATE image set with ID 1.x

SORTED BY Abstract.NumberOfSlicesInVolume ORDER:=descending SPLIT:=true

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.Abstract.VolumeIndex ORDER:=ascending SPLIT:=true

SORTED BY Dicom.Abstract.SlicePosition ORDER:=ascending SPLIT:=false

This rule will actually form sets from images that contain images thatare part of a ThinSliceVolume and that have been reconstructed with a“soft tissue” kernel. Given the protocol selection rule has specificallymatched for just CT studies, the conditions Dicom.Modality=“CT” andAbstract.Priorindex=0 are actually redundant, but could be useful if adifferent selection rule was used.

The images will first be sorted by the size of the volume of which theyare part (Abstract.NumberOfSlicesInVolume), then by DICOM series. Thesplit parameter in this case will ensure that an image set containsimages from on series only. A DICOM series can sometimes containmultiple non-consecutive volumes. The abstract tag VolumeIndex will thenindicate for each image, which of those volumes it is part of. If aseries contains only one volume, then this will be “1” for all images inthe series. The split=true in this part of the rule would result in aseparate image set for each of those volumes. Finally, within eachvolume, the images are ordered by slice position, but not split. Thisway we end up with one image set for each soft kernel thin slice volume,the largest volume being the first image set (ID 1.1). This ID will beused further in subsequent rules.

The rule to form an image set from any CR prior study in this example ismuch simpler:

IF (Dicom.Modality=“CR” and Abstract.Priorindex=1)

THEN CREATE image set with ID 10

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=false

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false

This creates one image set with ID=10 containing all images for thefirst prior study, if that is a CR.

In practice, additional rules, such as Image Set Rule 5 and 6 (seeabove) will be used to collect the remaining images of the primary Study1105. The remaining images are not shown in the layout depicted in theexample FIG. 2.

The Display Protocol 1145 contains multiple layouts. The one shown inFIG. 2 is defined as follows:

DEFINE Layout { ID=“Layout5”; NAME=”+PlainFilm” Viewports { { ID=50,Geometry=”(0,0)-(0.25,0.5)”}, { ID=51, Geometry=”(0.25,0)-(0.5,0.5)”}, {ID=52, Geometry=”(0,0.5)-(0.25,1)”}, { ID=53, Geometry=”(0.25,0.5)-(0.5,0.5)”}, { ID=54, Geometry=”(0.5,0)-(1,1)”, Style=”2D”} } }

In this example the geometry is defined in a coordinate system havingthe origin in the upper left corner of the screen with the x axispointing to the right and the y axis pointing down. Please note howparameters of the viewers can be set in the layout definition.Parameters can also be set or overridden in the assignment and stylerules, as will be explained next.

In this example, viewer assignment and style rules are as follows:

IF ImageSetExists (1.1) and ImageSetExists(10) THEN SHOW_LAYOUT Layout5WITH Viewport[0].AddImageSet(1.1) Viewport [0].Style=”VRT(diffuse)”Viewport [0].Colormap=”CTAngioSoftTissue” Viewport[1,2,3].AddImageSet(1.1) Viewport [1,2,3].Style=”MPR” Viewport[1,2,3].DataWindow=”DICOM1” Viewport [1].oriantation=”axial” Viewport[2].oriantation=”sagittal” Viewport [3].oriantation=”coronal” Viewport[4].AddImageSet(10) IF (ImageSet[10].Dicom.Columns > 1024) THENViewport[4].Zoom=”FitToWindow” ELSE Viewport[4].Zoom=”1:1”

In this particular example, the rule to select the layout is rathersimple: It is shown if the two image sets used exist. This is becausethe criteria to construct these images sets have been rather specific.As will be appreciated, the proposed system gives this type offlexibility.

ASPECTS OF THE INVENTION

Some aspects of this invention include methods of displaying one or moreSets of Images comprising the steps of:

a. selecting a primary Study;

b. selecting one or more Study Selection Parameters based on the primaryStudy;

c. selecting one or more Study Selection Rules based on the one or moreStudy Selection Parameters;

d. selecting one or more Sets of Images from a plurality of images basedon the one or more Study Selection Rules;

e. selecting one or more Display Protocol Selection Parameters based onthe one or more Sets of Images selected;

f. selecting one or more Display Protocol Selection Rules based on theone or more Display Protocol Selection Parameters;

g. selecting one or more Display Parameters using the one or moreDisplay Protocol Selection Rules; and

h. displaying the one or more Sets of Images according to the DisplayParameters.

Additional aspects include methods one or more Display Parameter areselected from the group consisting of Image Set Selection Parameters andView and Viewport Selection Parameters.

Further aspects include methods where the one or more Display Parametersare selected from the group consisting of Image Set Selection Rules,View and Viewport Selection Rules, and Display Protocol Selection Rules.

Yet further aspects include methods where the step of identifying one ormore Image Set Selection Rules is based on the one or more Image SetSelection Parameters.

Still further aspects include methods where the step of selecting one ormore Viewpoint Selection Rules is based on one or more View and ViewportSelection Parameters.

Other aspects include methods where the step of displaying the one ormore Sets of Images is based on one or more Display Protocol SelectionRules, one or more Image Set Selection Rules, and one or more View andViewport Selection Rules.

Still other aspects include methods where one or more of the StudySelection Parameters are selected from the group consisting of DICOMparameters and Abstract Tags.

Other aspects include methods where one or more of the Display ProtocolSelection Parameters are selected from the group consisting of DICOMparameters and Abstract Tags.

Additional aspects include methods where one or more of the Image SetSelection Parameters are selected from the group consisting of DICOMparameters and Abstract Tags.

Further aspects include methods where one or more of the View andViewport Selection Parameters are selected from the group consisting ofDICOM parameters and Abstract Tags.

More aspects include methods where one or more Study SelectionParameters are derived from a single reference image.

Still more aspects include methods where one or more Study SelectionParameters are derived from a single reference image DICOM Parameters.

Yet other aspects include methods where one or more Display ProtocolSelection Parameters are derived using a list of all values of a DICOMparameter occurring in any of the one or more Sets of Images.

Alternative aspects include methods where the one or more View andViewport Selection Rules contain protocols for one or more Viewportsdisplaying images as 2D.

Other alternative aspects include methods where the one or more View andViewport Selection Rules contain protocols for one or more Viewportsdisplaying images in a 3D rendering mode.

Further alternative aspects include methods where one or more StudySelection Parameters include one or more Abstract Tags selected from thegroup consisting of RelativeStudyAge, PriorIndex. NumImages, NumSeries,Num3DVolumes, Num4DSequences and HasReport.

In other aspects, this invention includes methods where one or more Viewand Viewport Selection Rules include one or more Abstract Tags selectedfrom the group consisting of Image Sets to be displayed, RenderingStyle, Additional image sets for image fusion, Image

Alignment, Colormap/Transfer Function, Slice Thickness, Zoom Factor,Camera position, Camera orientation and Labels/Overlay elements.

In still other aspects, this invention includes methods furthercomprising the steps of:

receiving one or more Sets of Images based on the Study Selection Rules;

selecting one or more Image Set Selection Parameters;

selecting one or more Image Set Selection Rules based on the one or moreImage Set Selection Parameters; and

displaying the one or more Sets of Images based on the Display ProtocolSelection Rules and the Image Set Selection Rules.

In another aspect, this invention includes methods of displaying one ormore Sets of Images comprising the steps of:

selecting one or more Study Selection Parameters;

selecting or more Study Selection Rules based on the one or more StudySelection Parameters;

receiving one or more Sets of Images based on the Study Selection Rules;

selecting one or more Display Protocol Selection Parameters based on theone or more Sets of Images selected;

selecting one or more Display Protocol Selection Rules based on the oneor more Display Protocol Selection Parameters; and

displaying the one or more Sets of Images based on the Display ProtocolSelection Rules.

Another aspect of this invention includes methods of displaying imagescomprising the steps of:

a. selecting one or more Study Selection Parameters;

b. selecting Study Selection Rules based on the one or more StudySelection Parameters;

c. receiving one or more images based on the Study Selection Rules;

d. selecting one or more Display Protocol Selection Parameters based onthe one or more images selected;

e. selecting Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;

f. selecting one or more Image Set Selection Parameters;

g. selecting Image Set Selection Rules based on the one or more ImageSet Selection Parameters;

h. selecting one or more View and Viewport Selection Parameters;

i. selecting View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; and

j. displaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

Other aspects of the invention include methods where the Study SelectionRule is:

IF (Primary.Dicom.BodyPartExamined=“CHEST” andPrimary.Dicom.Modality=“CR”) THEN SELECT other studies for loading WHERE(Other.Dicom. BodyPartExamined=“CHEST” and (Other.Dicom.Modality=“CR” orOther.Dicom.Modality=“CT”)).

In another aspect, this invention includes methods where the StudySelection Rule is:

IF (Primary.Dicom.BodyPartExamined=“CHEST” andPrimary.DicomList.Modality contains “CR”) THEN SELECT other studies forloading WHERE (Other.Dicom.BodyPartExamined=“CHEST” and(Other.DicomList.Modality contains “CR” or Other.DicomList.Modalitycontains “CT”)).

In other aspects, this invention includes methods where the StudySelection Rule is:

IF (Primary.Dicom.Modality=“MG” THEN SELECT other studies for loadingWHERE (Other.Dicom.Modality=“MG” and Other.Abstract.Priorindex<=3 andOther.Abstract.RelativeStudyAge<5*365).

In yet another aspect, this invention includes methods where theProtocol Selection Rule is:

IF (Primary.Dicom.BodyPartExamined=“ABDOMEN” andPrimary.Dicom.Modality=“CT” and Exists(Other1) andOther1.Dicom.Modality=“PET”) THEN SELECT “StandardPetCTProtocoll” withscore=10.

In aspects of the invention, methods include an Image Set Rule:

IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1.

Additionally, other aspects include methods where the Image Set Rule is:

IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1

SORTED BY Dicom.SeriesNumber ORDER:=ascending

SORTED BY Dicom.InstanceNumber ORDER:=ascending.

Still other aspects include methods where the Image Set Rule is:

IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1.x

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false.

Moreover, other aspects include methods where the Image Set Rule is:

IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1.x

SORTED BY Condition.CTSoftTisseKernel SPLIT:=true

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false.

Yet other aspects include methods where the Image Set Rule (Localizer)is:

IF (Dicom.Modality=“CT” and Condition.IsLocalizer=true)THEN CREATE image set with ID 1

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false.

Other aspects of the methods of this invention include an Image Set Rule(Images):

IF (Dicom.Modality=“CT” and Abstract.AlreadyReferenced=false)THEN CREATE image set with ID 2

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false.

Yet other aspects of the methods of this invention include using ImageSet Rule (Images):

IF (Dicom.Modality=“CT” and Abstract.AlreadyReferenced=false)THEN CREATE image set with ID 2

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false.

Additionally, other aspects include methods where the Display Parametersinclude Viewer Assignment Rule:

IF (Abstract.ImageSetID=1)

THEN SELECT image set with score=10.

Yet further aspects include methods where the Display Parameters includea Viewer Assignment Rule:

IF (Abstract.ImageSetID=2)

THEN SELECT image set with score=5.

Additional aspects include methods further comprising a ViewerAssignment Rule:

IF (Abstract.ImageSetID=2)

THEN SELECT image set with score=5.

In other aspects of this invention, methods include one or more StudySelection Rules comprising one or more Abstract Tags selected from thegroup consisting of:

-   -   (i) RelativeStudyAge indicates relative age of Study in days        compared to primary Study 1105.    -   (ii) PriorIndex indicates an index that enumerates all other        studies from youngest to oldest.    -   (iii) NumImages indicates number of images in Study.    -   (iv) NumSeries indicated number of image series in Study.    -   (v) Num3DVolumes indicates number of 3D volumes in Study.    -   (vi) Num4DSequences indicates number of 4D sequences in Study        (e.g. Cardiac CT).    -   (vii) HasReport indicates a flag that indicates if a report is        available for a Study.    -   (viii) IsThinSliceVolume.

Aspects of methods also include a step of displaying including use of anAbstract Tag DisplaySetID.

Other aspects of methods include Abstract Tag DisplaySetID having aStyle Rule selected from the group consisting of:

-   -   i) Rendering style (can be 2D, oblique, curved, MIP slab, 3D        MIP, VRT, shaded VRT, etc.);    -   ii) Image alignment (left, right, top, bottom, centered);    -   iii) Inverse display (black on white versus white on black);    -   iv) Colormap or transfer function;    -   v) Window/level (data window);    -   vi) Slice thickness;    -   vii) Zoom factor;    -   viii) Camera position and orientation; and    -   ix) Labels/OverlayDisplay of labels, annotations and other        overlay elements.

Still other methods include steps where the Style Rule is:

IF (Abstract.DisplaySetID>100 and

Abstract.DisplaySetID<105 and

Dicom.Modality=“PT”)

THEN SET

RenderingStyle:=“3D MIP”

Inverse:=true

DataWindow:=“2% 98%”.

Other aspects of methods include use of a Style Rule:

IF (Abstract.ImageSetID=200) THEN SET

RenderingStyle:=“MPR”

SliceThickness:=“20”

DataWindow:=“DICOM1”

ZoomFactor:=“FitToWindow”,

Another aspect of the present invention is a method of displaying one ormore Sets of Images comprising the steps of:

selecting one or more Study Selection Parameters;

identifying one or more Study Selection Rules based on the one or moreStudy Selection Parameters;

selecting one or more Sets of Images from a plurality of images based onthe one or more Study Selection Rules;

selecting one or more Display Protocol Selection Parameters based on theone or more Sets of Images selected;

identifying one or more Display Protocol Selection Rules based on theone or more Display Protocol Selection Parameters;

using the one or more Display Protocol Selection Rules to select one ormore Display Parameters; and

displaying the one or more Sets of Images according to the DisplayParameters.

Still other aspects of methods of displaying one or more Sets of Imagescomprising the steps of:

selecting one or more Study Selection Parameters;

selecting Study Selection Rules based on the one or more Study SelectionParameters;

selecting one or more Sets of Images based on the Study Selection Rules;

selecting one or more Display Protocol Selection Parameters based on theone or more Sets of Images selected;

selecting Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;

selecting one or more Image Set Selection Parameters;

selecting Image Set Selection Rules based on the one or more Image SetSelection Parameters;

selecting one or more View and Viewport Selection Parameters;

selecting View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; and

displaying the one or more Sets of Images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In systems of this invention, aspects include system for displaying oneor more Sets of Images comprising:

one or more digital data processors for carrying out the stepsincluding:

-   -   selecting one or more Study Selection Parameters;    -   selecting one or more Study Selection Rules based on the one or        more Study Selection Parameters;    -   receiving one or more Sets of Images based on the Study        Selection Rules;    -   selecting one or more Display Protocol Selection Parameters        based on the one or more Sets of Images selected;    -   selecting Display Protocol Selection Rules based on the one or        more Display Protocol Selection Parameters;    -   selecting one or more Image Set Selection Parameters;    -   selecting one or more Image Set Selection Rules based on the one        or more Image Set Selection Parameters;    -   selecting one or more View and Viewport Selection Parameters;    -   selecting View and Viewport Selection Rules based on the one or        more View and Viewport Selection Parameters; and

graphics resources for displaying the one or more Sets of Images basedon one or more of Display Protocol Selection Rules, Image Set SelectionRules, the View and Viewport Selection Rules, and Viewer AssignmentRules.

Additional system aspects include Sets of Images comprising:

one or more digital data processors for carrying out the steps accordingto any of the above described methods aspects;

and graphics resources for displaying the one or more Sets of Images.

In an embodiment of the invention, a method of displaying imagescomprising the steps of:

selecting one or more Study Selection Parameters;

identifying Study Selection Rules based on the one or more StudySelection Parameters;

receiving one or more images based on the Study Selection Rules;

selecting one or more Display Protocol Selection Parameters based on theone or more images selected;

identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;

selecting one or more Image Set Selection Parameters;

identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;

selecting one or more View and Viewport Selection Parameters;

identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; and

displaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In another embodiment of the invention, a method of displaying imagescomprises the steps of:

selecting one or more Study Selection Parameters;identifying a Study Selection Rule based on the one or more StudySelection Parameters, where the Study Selection Rule is:

IF (Primary.Dicom.BodyPartExamined=“CHEST” andPrimary.Dicom.Modality=“CR”)

THEN SELECT other studies for loading WHERE (Other.Dicom.BodyPartExamined=“CHEST” and (Other.Dicom.Modality=“CR” orOther.Dicom.Modality=“CT”));receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In an alternative embodiment of the invention, a method of displayingimages comprises the steps of:

selecting one or more Study Selection Parameters;identifying a Study Selection Rule based on the one or more StudySelection Parameters, where the Study Selection Rule is:IF (Primary.Dicom.BodyPartExamined=“CHEST” andPrimary.DicomList.Modality contains “CR”) THEN SELECT other studies forloading WHERE (Other.Dicom.BodyPartExamined=“CHEST” and(Other.DicomList.Modality contains “CR” or Other.DicomList.Modalitycontains “CT”));receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters; selecting one or more View and Viewport SelectionParameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In another alternative embodiment of the invention, a method ofdisplaying images comprises the steps of:

selecting one or more Study Selection Parameters;identifying a Study Selection Rule based on the one or more StudySelection Parameters, where the Study Selection Rule is:IF (Primary.Dicom.Modality=“MG” THEN SELECT other studies for loadingWHERE (Other.Dicom.Modality=“MG” and Other.Abstract.Priorindex<=3 andOther.Abstract.RelativeStudyAge<5*365);receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters; selecting one or more View and Viewport SelectionParameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In an embodiment of the invention, a method of displaying imagescomprises the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying a Display Protocol Selection Rule based on the one or moreDisplay Protocol Selection Parameters, where the Display ProtocolSelection Rule is:IF (Primary.Dicom.BodyPartExamined=“ABDOMEN” andPrimary.Dicom.Modality=“CT” and Exists(Other1) andOther1.Dicom.Modality=“PET”) THEN SELECT “StandardPetCTProtocoll” withscore=10;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In a further embodiment of the invention, a method of displaying imagescomprises the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters, where the Image Set Selection Rule is:

IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In an additional embodiment of the invention, a method of displayingimages comprises the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters, where the Image Set Selection Rule is:

IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1

SORTED BY Dicom.SeriesNumber ORDER:=ascending

SORTED BY Dicom.InstanceNumber ORDER:=ascending;

selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In another embodiment of the invention, a method of displaying imagescomprises the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters, where the Image Set Selection Rule is:

IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1.x

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false;

selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In another further embodiment of the invention, a method of displayingimages comprises the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters, where the Image Set Selection Rule is:

IF (Dicom.Modality=“CT” and Abstract.Priorindex=0)

THEN CREATE image set with ID 1.x

SORTED BY Condition.CTSoftTisseKernel SPLIT:=true

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false;

selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In an embodiment of the invention, a method of displaying imagescomprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying an Image Set Selection Rule based on the one or more ImageSet Selection Parameters, where the Image Set Selection Rule (Localizer)is:IF (Dicom.Modality=“CT” and Condition.IsLocalizer=true)THEN CREATE image set with ID 1

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false;

selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In a further embodiment of the invention, a method of displaying imagescomprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying an Image Set Selection Rule based on the one or more ImageSet Selection Parameters, where the Image Set Selection Rule (Localizer)is:IF (Dicom.Modality=“CT” and Condition.IsLocalizer=true)THEN CREATE image set with ID 1

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false;

selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In a still further embodiment of the invention, a method of displayingimages comprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying an Image Set Selection Rule based on the one or more ImageSet Selection Parameters, where the Image Set Selection Rule (Localizer)is:IF (Dicom.Modality=“CT” and Abstract.AlreadyReferenced=false)THEN CREATE image set with ID 2

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false;

selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In a further embodiment of the invention, a method of displaying imagescomprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying an Image Set Selection Rule based on the one or more ImageSet Selection Parameters, where the Image Set Selection Rule (Localizer)is:IF (Dicom.Modality=“CT” and Abstract.AlreadyReferenced=false)THEN CREATE image set with ID 2

SORTED BY Dicom.SeriesNumber ORDER:=ascending SPLIT:=true

SORTED BY Dicom.InstanceNumber ORDER:=ascending SPLIT:=false;

selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In another embodiment of the invention, a method of displaying imagescomprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected, where the one or more Display ProtocolSelection Parameters include Viewer Assignment Rule:

IF (Abstract.ImageSetID=1)

THEN SELECT image set with score=10;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In an additional embodiment of the invention, a method of displayingimages comprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected, where the one or more Display ProtocolSelection Parameters include Viewer Assignment Rule:

IF (Abstract.ImageSetID=1)

THEN SELECT image set with score=10;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In a further embodiment of the invention, a method of displaying imagescomprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected, where the one or more Display ProtocolSelection Parameters include Viewer Assignment Rule:

IF (Abstract.ImageSetID=2)

THEN SELECT image set with score=5;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules.

In a still further embodiment of the invention, a method of displayingimages comprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters;displaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules; andselecting Viewer Assignment Rule:

IF (Abstract.ImageSetID=2)

THEN SELECT image set with score=5.

In an embodiment of the invention, a method of displaying imagescomprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters, where the one or more Study Selection Rulescomprise one or more Abstract Tags selected from the group consistingof:

-   -   (i) RelativeStudyAge indicates relative age of Study in days        compared to primary Study.    -   (ii) PriorIndex indicates an index that enumerates all other        studies from youngest to oldest.    -   (iii) NumImages indicates number of images in Study.    -   (iv) NumSeries indicated number of image series in Study.    -   (v) Num3DVolumes indicates number of 3D volumes in Study.    -   (vi) Num4DSequences indicates number of 4D sequences in Study        (e.g. Cardiac CT).    -   (vii) HasReport indicates a flag that indicates if a report is        available for a Study;        receiving one or more images based on the Study Selection Rules;        selecting one or more Display Protocol Selection Parameters        based on the one or more images selected;        identifying Display Protocol Selection Rules based on the one or        more Display Protocol Selection Parameters;        selecting one or more Image Set Selection Parameters;        identifying Image Set Selection Rules based on the one or more        Image Set Selection Parameters;        selecting one or more View and Viewport Selection Parameters;        identifying View and Viewport Selection Rules based on the one        or more View and Viewport Selection Parameters; and        displaying the one or more images based on the Display Protocol        Selection Rules, the Image Set Selection Rules and the View and        Viewport Selection Rules.

In another embodiment of the invention, a method of displaying imagescomprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules, where the step of displaying includes an Abstract TagDisplaySetID.

In another embodiment of the invention, a method of displaying imagescomprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules, where the step of displaying includes an Abstract TagDisplaySetID, where the Abstract Tag DisplaySetID has a Style Ruleselected from the group consisting of:

-   -   i) Rendering style (can be 2D, oblique, curved, MIP slab, 3D        MIP, VRT, shaded VRT, etc.);    -   ii) Image alignment (left, right, top, bottom, centered);    -   iii) Inverse display (black on white versus white on black);    -   iv) Colormap or transfer function;    -   v) Window/level (data window);    -   vi) Slice thickness;    -   vii) Zoom factor;    -   viii) Camera position and orientation; and    -   ix) Labels/OverlayDisplay of labels, annotations and other        overlay elements.

In a further embodiment of the invention, a method of displaying imagescomprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules, where the step of displaying includes an Abstract TagDisplaySetID, where the Abstract Tag DisplaySetID has a Style Ruleselected from the group consisting of:

-   -   i) Rendering style (can be 2D, oblique, curved, MIP slab, 3D        MIP, VRT, shaded VRT, etc.);    -   ii) Image alignment (left, right, top, bottom, centered);    -   iii) Inverse display (black on white versus white on black);    -   iv) Colormap or transfer function;    -   v) Window/level (data window);    -   vi) Slice thickness;    -   vii) Zoom factor;    -   viii) Camera position and orientation; and    -   ix) Labels/OverlayDisplay of labels, annotations and other        overlay elements, where the Style Rule is:    -   IF (Abstract.DisplaySetID>100 and        -   Abstract.DisplaySetID<105 and        -   Dicom.Modality=“PT”)    -   THEN SET        -   RenderingStyle:=“3D MIP”        -   Inverse:=true        -   DataWindow:=“2% 98%”.

In a still further embodiment of the invention, a method of displayingimages comprising the steps of:

selecting one or more Study Selection Parameters;identifying Study Selection Rules based on the one or more StudySelection Parameters;receiving one or more images based on the Study Selection Rules;selecting one or more Display Protocol Selection Parameters based on theone or more images selected;identifying Display Protocol Selection Rules based on the one or moreDisplay Protocol Selection Parameters;selecting one or more Image Set Selection Parameters;identifying Image Set Selection Rules based on the one or more Image SetSelection Parameters;selecting one or more View and Viewport Selection Parameters;identifying View and Viewport Selection Rules based on the one or moreView and Viewport Selection Parameters; anddisplaying the one or more images based on the Display ProtocolSelection Rules, the Image Set Selection Rules and the View and ViewportSelection Rules, where the step of displaying includes an Abstract TagDisplaySetID, where the Abstract Tag DisplaySetID has a Style Ruleselected from the group consisting of:

-   -   i) Rendering style (can be 2D, oblique, curved, MIP slab, 3D        MIP, VRT, shaded VRT, etc.);    -   ii) Image alignment (left, right, top, bottom, centered);    -   iii) Inverse display (black on white versus white on black);    -   iv) Colormap or transfer function;    -   v) Window/level (data window);    -   vi) Slice thickness;    -   vii) Zoom factor;    -   viii) Camera position and orientation; and    -   ix) Labels/OverlayDisplay of labels, annotations and other        overlay elements, where the Style Rule is:    -   IF (Abstract.ImageSetID=200)    -   THEN SET        -   RenderingStyle:=“MPR”        -   SliceThickness:=“20”        -   DataWindow:=“DICOM1”        -   ZoomFactor:=“FitToWindow”.

In an embodiment of the invention, a method of displaying one or moreSets of Images comprises the steps of:

selecting one or more Study Selection Parameters;

selecting or more Study Selection Rules based on the one or more StudySelection Parameters;

receiving one or more Sets of Images based on the Study Selection Rules;

selecting one or more Display Protocol Selection Parameters based on theone or more Sets of Images selected;

selecting one or more Display Protocol Selection Rules based on the oneor more Display Protocol Selection Parameters; and

displaying the one or more Sets of Images based on the Display ProtocolSelection Rules.

In a further embodiment of the invention, a method of displaying one ormore Sets of Images comprises the steps of:

a. selecting a primary Study;

b. selecting one or more Study Selection Parameters based on the primaryStudy;

c. selecting one or more Study Selection Rules based on the one or moreStudy Selection Parameters;

d. selecting one or more Sets of Images from a plurality of images basedon the one or more Study Selection Rules;

e. selecting one or more Display Protocol Selection Parameters based onthe one or more Sets of Images selected;

f. selecting one or more Display Protocol Selection Rules based on theone or more Display Protocol Selection Parameters;

g. selecting one or more Display Parameters using the one or moreDisplay Protocol Selection Rules, where the one or more DisplayParameter are selected from the group consisting of Image Set SelectionParameters and View and Viewport Selection Parameters; and

h. displaying the one or more Sets of Images according to the DisplayParameters.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where at least one study from the plurality of ImageSets is a two dimensional image.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where at least one study from the plurality of ImageSets is a three dimensional (3D) image displayed with a 3D renderingstyle.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where at least one of the one or more Viewportsdisplays an oblique cross section through a volumetric image set.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where at least one of the one or more Viewportsdisplays a maximum intensity projection of an image set.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where at least one of the one or more Viewportsdisplays a post processed rendering of an image set.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where at least one of the one or more Viewportsdisplays a thick slab image.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where at least one of the one or more Viewportsdisplays a volume rendered image.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where at least one of the one or more Viewportsdisplays a three dimensional image.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where one or more Study Selection Rules used DICOMparameters and Abstract Tags derived from a single reference image.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where the primary Study selected is a single referenceimage.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where the primary Study selected is a single referenceimage, where one or more Study Selection Rules are derived from thesingle reference image DICOM Parameters.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where the one or more Viewport Assignment Rulescontain protocols for displaying two dimensional images in the one ormore Viewports.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where the one or more Abstract Tags are selected fromthe group consisting of RelativeStudyAge, PriorIndex. NumImages,NumSeries, Num3DVolumes, Num4DSequences and HasReport.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where the one or more Viewport Assignment Rulesinclude one or more Abstract Tags selected from the group consisting ofImage Sets to be displayed, Rendering Style, Additional image sets forimage fusion, Image Alignment, Colormap/Transfer Function, SliceThickness, Zoom Factor, Camera position, Camera orientation andLabels/Overlay elements.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where the one or more Image Set Rules are selectedfrom selection, sorting, and breaking rules, where the one or more ImageSet Rules are Boolean expressions that contain parameters selected fromthe group consisting of DICOM parameters, abstract tags, andused-defined functions.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where in order to specify image sorting, the Image SetRules contain an ordered list of sorting criteria.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where in order to specify image sorting, the Image SetRules contain an ordered list of sorting criteria, where a split flag isused in order to specify image splitting.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where Abstract Tags are used in Image Set Rules.

In an embodiment of the invention, a system of displaying one or moreSets of Images from a plurality of images comprises a processor capableof selecting a primary Study from a plurality of studies, one or moredigital data processors capable of carrying out the steps includingapplying one or more Study Selection Rules to generate a plurality ofsecond studies based on one or more DICOM parameters and one or moreAbstract Tags from the primary Study and one or more DICOM parametersand one or more Abstract Tags from the plurality of studies, where theplurality of second studies include the primary Study, applying one ormore Protocol Selection Rules to select a Display Protocol, where theone or more Protocol Selection Rules are based on one or more DICOMparameters and one or more Abstract Tags from the plurality of secondstudies, applying one or more Image Set Rules to define a plurality ofImage Sets from the plurality of second studies, applying one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying one or more Style Rules to define a rendering styleand rendering parameters of the one or more Viewports and graphicsresources for displaying the plurality of Image Sets based on one ormore of the one or more Protocol Selection Rules, the one or more ImageSet Rules, the one or more Viewport Assignment Rules, and the one ormore Style Rules, where Abstract Tags are used in Image Set Rules, wherean Abstract Tag identifies whether an image has already been placed intoan Image Set.

In an alternative embodiment of the invention, a system of displayingone or more Sets of Images from a plurality of images comprisesselecting one or more studies from a plurality of studies, one or moredigital data processors for carrying out the steps including applyingone or more Protocol Selection Rules to select a Display Protocol, wherethe one or more Protocol Selection Rules are based on one or more DICOMparameters and Abstract Tags from the plurality of studies, applying oneor more Image Set Rules to define a plurality of Image Sets from theplurality of studies, applying one or more Viewport Assignment Rules toassign one or more Image Sets from the plurality of Image Sets to one ormore Viewports defined in the Display Protocol, applying one or moreStyle Rules to define a rendering style and rendering parameters of theone or more Viewports and graphics resources for displaying the one ormore Image Sets based on one or more of the Protocol Selection Rules,the one or more Image Set Rules, the one or more Viewport AssignmentRules, and the one or more Style Rules, where at least one of the one ormore Viewports displays a three dimensional image.

In another alternative embodiment of the invention, a method ofdisplaying one or more Sets of Images from a plurality of imagescomprises selecting a primary Study from a plurality of studies,executing on a server digital data processor a render server programwhich applies one or more of one or more Study Selection Rules, one ormore Protocol Selection Rule, one or more Image Set Rules, one or moreViewport Assignment Rules, and one or more Style Rules to display theone or more Sets of Images including the steps of applying the one ormore Study Selection Rules to generate a plurality of second studiesbased on one or more DICOM parameters and one or more Abstract Tags fromthe primary Study and one or more DICOM parameters and one or moreAbstract Tags from the plurality of studies, where the plurality ofsecond studies include the primary Study, applying the one or moreProtocol Selection Rules to select a Display Protocol, where the one ormore Protocol Selection Rules are based on one or more DICOM parametersand one or more Abstract Tags from the plurality of second studies,applying the one or more Image Set Rules to define a plurality of ImageSets from the plurality of second studies, applying the one or moreViewport Assignment Rules to assign one or more Image Sets from theplurality of Image Sets to one or more Viewports defined in the DisplayProtocol, applying the one or more Style Rules to define a renderingstyle and rendering parameters of the one or more Viewports anddisplaying the one or more Sets of Images in one or more Viewports basedon one or more of the Protocol Selection Rule, the Image Set Rule, theone or more Viewport Assignment Rules, and the one or more Style Rules,where at least one of the one or more Viewports displays a volumerendered image.

In a further embodiment of the invention, a method of displaying one ormore Sets of Images from a plurality of images comprises selecting aprimary Study from a plurality of studies, executing on a server digitaldata processor a render server program which applies one or more of oneor more Study selection Rules, one or more Protocol Selection Rules, oneor more Image Set Rules, one or more Viewport Assignment Rules, and oneor more Style Rules to display the one or more Sets of Images includingthe steps of applying the one or more Study Selection Rules to generatea plurality of second studies based on DICOM parameter BodyPartExamined,DICOM parameter Modality, DICOM parameter RelativeStudyAge and AbstractTag RelativeStudyAge, Abstract Tag PriorIndex, Abstract Tag NumImages,Abstract Tag NumSeries, Abstract Tag Num3DVolumes, Abstract TagNum4DSequences and Abstract Tag HasReport from the plurality of studies,where the plurality of second studies include the primary Study,applying the one or more Protocol Selection Rules to select a DisplayProtocol, where the one or more Protocol Selection Rules are based onDICOM parameter BodyPartExamined, DICOM parameter Modality, DICOMparameter HasThisSliceVolumes, DICOM parameter StudyDescription andAbstract Tags from the plurality of second studies, applying the one ormore Image Set Rules to define a plurality of Image Sets from theplurality of second studies, applying the one or more ViewportAssignment Rules to assign one or more Image Sets from the plurality ofImage Sets to one or more Viewports defined in the Display Protocol,applying the one or more Style Rules to define a rendering style andrendering parameters of the one or more Viewports and displaying the oneor more Sets of Images in one or more Viewports based on one or more ofthe one or more Protocol Selection Rules, the one or more Image SetRules, the one or more Viewport Assignment Rules, and the one or moreStyle Rules, where at least one of the one or more Viewports displays apost processed rendering of an image set.

In a further embodiment of the invention, a method of displaying one ormore Sets of Images from a plurality of images comprises selecting aprimary Study from a plurality of studies, executing on a server digitaldata processor a render server program which applies one or more of oneor more Study selection Rules, one or more Protocol Selection Rules, oneor more Image Set Rules, one or more Viewport Assignment Rules, and oneor more Style Rules to display the one or more Sets of Images includingthe steps of applying the one or more Study Selection Rules to generatea plurality of second studies based on DICOM parameter BodyPartExamined,DICOM parameter Modality, DICOM parameter RelativeStudyAge and AbstractTag RelativeStudyAge, Abstract Tag PriorIndex, Abstract Tag NumImages,Abstract Tag NumSeries, Abstract Tag Num3DVolumes, Abstract TagNum4DSequences and Abstract Tag HasReport from the plurality of studies,where the plurality of second studies include the primary Study,applying the one or more Protocol Selection Rules to select a DisplayProtocol, where the one or more Protocol Selection Rules are based onDICOM parameter BodyPartExamined, DICOM parameter Modality, DICOMparameter HasThisSliceVolumes, DICOM parameter StudyDescription andAbstract Tags from the plurality of second studies, applying the one ormore Image Set Rules to define a plurality of Image Sets from theplurality of second studies, applying the one or more ViewportAssignment Rules to assign one or more Image Sets from the plurality ofImage Sets to one or more Viewports defined in the Display Protocol,applying the one or more Style Rules to define a rendering style andrendering parameters of the one or more Viewports and displaying the oneor more Sets of Images in one or more Viewports based on one or more ofthe one or more Protocol Selection Rules, the one or more Image SetRules, the one or more Viewport Assignment Rules, and the one or moreStyle Rules, where at least one of the one or more Viewports displays apost processed rendering of an image set, where the step of displayingis carried out on a client display device.

What is claimed is:
 1. A method comprising: (A) receiving at a servercomprising a server digital data processor a patient ID corresponding toa patient from a client computer; (B) identifying a first listcomprising a plurality of studies each corresponding to studiesundertaken of the patient ID; (C) sending to the client computer thefirst list; (D) receiving at the server a first selection indicating aprimary Study selected from the first list generated in step (B) fromthe client computer; (E) receiving at the server a second selectionindicating one or more Study Selection Rule parameters from the clientcomputer; (F) responding to the client computer, comprising: (a)executing on the server digital data processor a render server programwhich selects a Study Selection Rule based on one or more StudySelection Rule parameters; (b) selecting a secondary Study based on theStudy Selection Rule; (c) applying a Protocol Selection Rule to select aDisplay Protocol, where the Protocol Selection Rule is based on one ormore parameters selected from the group consisting of one or moreDigital Imaging and Communication in Medicine (DICOM) parameters presentin the primary Study and one or more DICOM parameters present in thesecondary Study; (d) rendering one or more first Views of the primaryStudy and one or more second Views of the secondary Study based on theDisplay Protocol; and (e) sending to the client computer the one or morefirst Views and the one or more second Views to be displayed on theclient computer.
 2. The method of claim 1, where in step (E) the one ormore Study Selection Rule parameters are selected from the groupconsisting of RelativeStudyAge, PriorIndex, NumImages, NumSeries,Num3DVolumes, Num4DSequences and HasReport.
 3. The method of claim 1,where in step (E) the one or more Study Selection Rule parametersspecify image type of the secondary Study is the same as image type ofthe primary Study.
 4. The method of claim 1, where in step (E) the oneor more Study Selection Rule parameters specify that the secondary Studydisplays the same type of disorder or disease as the primary Study. 5.The method of claim 1, where in step (E) the one or more Study SelectionRule parameters specify a Study Selection Rule pseudo code, where theStudy Selection Rule pseudo code comprises IF (Primary.Dicom.Disease) is“DISEASE 1”, and (Primary.Dicom.Modality=IMAGE TYPE 1”), THEN SELECTother studies for loading, WHERE (Other.Dicom.Disease)=“DISEASE 1”) and(Primary.Dicom.Modality=“IMAGE TYPE 2”).
 6. The method of claim 5, wherethe Study Selection Rule pseudo code further comprises“Other.Dicom.Modality=“IMAGE TYPE 2”.
 7. The method of claim 1, where instep (E) the one or more Study Selection Rule parameters specify thatthe secondary Study displays the same anatomical location as the primaryStudy.
 8. The method of claim 7, where in step (E) the one or more StudySelection Rule parameters specify a Study Selection Rule pseudo code,where the Study Selection Rule pseudo code comprises IF(Primary.Dicom.BodyPartExamined) is “ANATOMICAL REGION 1”, and(Primary.Dicom.Modality=IMAGE TYPE 1”), THEN SELECT other studies forloading, WHERE (Other.Dicom.BodyPart Examined=ANATOMICAL REGION 1”) and(Other.Dicom.Modality=“IMAGE TYPE 2”).
 9. The method of claim 8, wherethe Study Selection Rule pseudo code further comprises“Other.Dicom.Modality=“IMAGE TYPE 2”.
 10. A method comprising: (A)receiving at a server comprising a server digital data processor apatient ID corresponding to a patient from a client computer; (B)identifying a first list comprising a plurality of studies eachcorresponding to studies undertaken of the patient ID; (C) sending tothe client computer the first list; (D) receiving at the server a firstselection indicating a primary Study selected from the first listgenerated in step (B) from the client computer; (E) receiving at theserver a second selection comprising RelativeStudyAge and one or moreadditional Study Selection Rule parameters from the client computer; (F)responding to the client computer, comprising: (a) executing on theserver digital data processor a render server program which selects aStudy Selection Rule based on RelativeStudyAge and one or moreadditional Study Selection Rule parameters; (b) selecting a secondaryStudy based on the Study Selection Rule; (c) rendering one or more firstViews of the primary Study and one or more second Views of the secondaryStudy; and (d) sending to the client computer the one or more firstViews and the one or more second Views to be displayed on the clientcomputer.
 11. The method of claim 10, where in step (E) the one or moreadditional Study Selection Rule parameters specify image type of thesecondary Study is the same as image type of the primary Study.
 12. Themethod of claim 10, where in step (E) the one or more additional StudySelection Rule parameters specify that the secondary Study displays thesame type of disorder or disease as the primary Study.
 13. The method ofclaim 10, where in step (E) the one or more additional Study SelectionRule parameters specify a Study Selection Rule pseudo code, where theStudy Selection Rule pseudo code comprises IF (Primary.Dicom.Disease) is“DISEASE 1”, and (Primary.Dicom.Modality=IMAGE TYPE 1”), THEN SELECTother studies for loading, WHERE (Other.Dicom.Disease)=“DISEASE 1”) and(Primary.Dicom.Modality=“IMAGE TYPE 2”).
 14. The method of claim 13,where the Study Selection Rule pseudo code further comprises“Other.Dicom.Modality=“IMAGE TYPE 2”.
 15. The method of claim 10, wherein step (E) the one or more additional Study Selection Rule parametersspecify that the secondary Study displays the same anatomical locationas the primary Study.
 16. The method of claim 15, where in step (E) theone or more additional Study Selection Rule parameters specify a StudySelection Rule pseudo code, where the Study Selection Rule pseudo codecomprises IF (Primary.Dicom.BodyPartExamined) is “ANATOMICAL REGION 1”,and (Primary.Dicom.Modality=IMAGE TYPE 1”), THEN SELECT other studiesfor loading, WHERE (Other.Dicom.BodyPart Examined=ANATOMICAL REGION 1”)and (Other.Dicom.Modality=“IMAGE TYPE 2”).
 17. The method of claim 16,where the Study Selection Rule pseudo code further comprises“Other.Dicom.Modality=“IMAGE TYPE 2”.
 18. A method comprising: (A)receiving at a server comprising a server digital data processor apatient ID corresponding to a patient from a client computer; (B)identifying a first list comprising a plurality of studies eachcorresponding to studies undertaken of the patient ID; (C) sending tothe client computer the first list; (D) receiving at the server a firstselection indicating a primary Study selected from the first listgenerated in step (B) from the client computer; (E) receiving at theserver a second selection comprising a RelativeStudyAge and one or moreadditional Study Selection Rule parameters from the client computer; (F)responding to the client computer, comprising: (a) executing on theserver digital data processor a render server program which selects aStudy Selection Rule based on the RelativeStudyAge and one or moreadditional Study Selection Rule parameters; (b) identifying a pluralityof secondary studies based on the primary Study and the Study SelectionRule, where the Study Selection Rule identifies one or more secondaryStudies from the plurality of secondary studies; and (c) sending to theclient computer one or more Views of the primary Study and one or moreViews of the one or more secondary Studies to be displayed on the clientcomputer.
 19. The method of claim 18, where in step (E) the one or moreadditional Study Selection Rule parameters specify image type of the oneor more secondary Studies is the same as image type of the primaryStudy.
 20. The method of claim 18, where in step (E) the one or moreadditional Study Selection Rule parameters specify that the one or moresecondary Studies display the same type of disorder or disease as theprimary Study.